Search AI Products and News

With the rapid development of artificial intelligence technology, deepfake content has gradually attracted widespread social attention. To address this emerging issue, California has introduced a series of new laws and regulations at the beginning of the new year, aimed at strengthening the regulation of deepfake content generated by artificial intelligence. These laws will affect social media platforms, content creators, and related industries, marking the entry of AI technology application regulation into a new phase. Note on image source: Image generated by AI, image licensed by Midjourney. One of the important laws expands the scope.

During a recent signing ceremony, California Governor Gavin Newsom announced a series of new laws aimed at the artificial intelligence (AI) industry, which are relatively strict on a national level. The new regulations comprise five items, three of which specifically address AI deepfake technology that could impact elections, while the other two concern the cloning of Hollywood actors' voices and images. Image source note: Image generated by AI, image authorized by service provider Midjourney. The new law AB2655 requires large online platforms...

San Francisco's Deputy Mayor Yvonne Meré has initiated a lawsuit against 16 websites that exploit AI technology to create deepfake pornographic content without the consent of women and girls. The lawsuit addresses the harmful trend among teenagers, particularly regarding the use of "strip apps" to manipulate peers' images. These websites garnered 200 million visits in their first six months, offering free initial services followed by paid options....

Telecom network fraud methods are constantly evolving, posing a threat to public property security. Major types include 'screen sharing' fraud, which involves inducing victims to enable screen sharing to obtain personal banking information for theft; 'AI deepfake' fraud, which utilizes technology to synthesize false audio and video, gaining trust before misleading victims into transferring money or providing sensitive information; false online investment fraud that uses high returns as bait to lure individuals into investing before siphoning off funds; and fake transaction fraud in online gaming products, which deceives players into making offline transactions through fictitious trading information, resulting in financial losses. Prevention measures are necessary.

Qihoo 360 Group released the '2024 AI Security Report', indicating that AI-based deepfake fraud surged by 3000% in 2023. AI-based phishing emails increased by 1000%. APT organizations with national backgrounds have used AI to carry out over a dozen cyber attack incidents. The malicious use of artificial intelligence technology is expected to grow rapidly.

In September 2023, the usage of applications and websites that employ artificial intelligence for deepfakes skyrocketed, hitting 24 million visits. Social media advertising has significantly boosted these services, with ad links on social media increasing by over 2400%, raising concerns about non-consensual deepfake pornography. As AI technology advances, the production of deepfake software has become easier, making ordinary individuals targets and raising privacy and legal issues. In response to this trend, some platforms, including TikTok and Meta Platforms, have begun implementing measures such as blocking related keywords.

CBS News has established a verification department focused on addressing AI deepfakes and misinformation. The department is led by CBS News and television's Senior Vice Presidents Claudia Milne and Ross Dagen. CBS plans to hire specialists, invest in new technologies, and produce segments explaining misinformation to help viewers better understand it.